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Abstract 

We study the utility maximization problem for power utility ran- 
dom fields in a semimartingale financial market, with and without 
intermediate consumption. The notion of an opportunity process is 
introduced as a reduced form of the value process of the resulting 
stochastic control problem. We show how the opportunity process 
describes the key objects: optimal strategy, value function, and dual 
problem. The results are applied to obtain monotonicity properties of 
the optimal consumption. 
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1 Introduction 

We consider the utility maximization problem in a semimartingale model 
for a financial market, with and without intermediate consumption. While 
the model is general, we focus on power utilities. If the maximization is 
seen as a stochastic control problem, the homogeneity of these utilities leads 
to a factorization of the value process into a power of the current wealth 
and a process L around which our analysis is built. This corresponds to 
the usual factorization of the value function in a Markovian setting. The 
process L is called opportunity process as Lt encodes the conditional expected 
utility that can be attained from time t. This name was introduced by 
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Cerny and Kallsen [T] in the context of mean-variance hedging for an object 
that is analogous, although introduced in a different way by those authors. 
Surprisingly, there exists no general study of L for the case of power utility, 
which is a gap we try to fill here. 

The opportunity process is a suitable tool to derive qualitative results 
about the optimal consumption strategy. Indeed, we first establish the con- 
nection between L and the solution Y of the convex-dual problem. Since 
Y is related to the optimal consumption by the marginal utility, this leads 
to a feedback formula for the optimal consumption in terms of L for gen- 
eral semimartingale models. Previous results in this direction (see Stoikov 
and Zariphopoulou [25j) required a Markovian model and the verification of 
a solution of the Hamilton- Jacobi-Bellman equation. Via the feedback for- 
mula, seemingly abstract results about the opportunity process translate to 
properties of the optimal consumption which are of direct economic interest. 
In particular, we derive monotonicity properties and bounds that are quite 
explicit despite the generality of the model. 

The present paper combines tools from convex duality and dynamic pro- 
gramming to study the utility maximization problem from a "global" point 
of view. The study of the local structure requires a more computational 
approach presented in a companion paper |21) and yields, in particular, a 
formula for the optimal trading strategy in terms of the opportunity pro- 
cess. That formula cannot be obtained by the abstract arguments of the 
present paper. However, its derivation requires the structures that we intro- 
duce here, and therefore some details in our exposition are motivated by the 
requirements of the companion paper. 

This paper is organized as follows. After the introduction, we discuss 
power utility random fields and specify the optimization problem in detail. 
Section [3] introduces the opportunity process L via dynamic programming 
and examines its basic properties. Section H] relates L to convex duality the- 
ory and reverse Holder inequalities, which is useful to obtain bounds for the 
opportunity process. Section [5] contains the feedback formula and the appli- 
cations to the study of the optimal consumption. Section [6] completes the 
picture by a brief description of the formula for the optimal trading strategy. 
Two appendices supply the necessary results about dynamic programming 
and duality theory. 

We refer to Jacod and Shiryaev [8] for unexplained notation. 

2 The Optimization Problem 

Financial Market. We fix the time horizon T G (0,oo) and a filtered 
probability space (il, J-", (J-()4g[o,T]) -P) satisfying the usual assumptions of 
right-continuity and completeness, as well as Tq = {0, $7} P-a.s. We consider 
an M^-valued cadlag semimartingale R with Rq = 0. The (componentwise) 



2 



stochastic exponential S = £{R) represents the discounted price processes 
of d risky assets, while R stands for their returns. Our agent also has a bank 
account paying zero interest at his disposal. 



Trading Strategies and Consumption. The agent is endowed with a 
deterministic initial capital xq > 0. A trading strategy is a predictable R- 
integrable M'^-valued process vr, where the zth component is interpreted as 
the fraction of wealth (or the portfolio proportion) invested in the ith risky 
asset. A consumption strategy is a nonnegative optional process c such that 
Jq Ctdt < Qo P-a.s. We want to consider two cases. Either consumption 
occurs only at the terminal time T (utility from "terminal wealth" only); 
or there is intermediate consumption plus a bulk consumption at the time 
horizon. To unify the notation, we define the measure ^ on [0, T] by 



fi{dt) :-- 



in the case without intermediate consumption, 
dt in the case with intermediate consumption. 



We also define := fj, + ^{T}i where 6^x} is the unit Dirac measure at T. 
The wealth process X{tt,c) corresponding to a pair (vr, c) is described by the 
linear equation 

Xt{7r,c) =xo+ [ Xs-{7T,c)TTsdRs- [ c,/x(a!s), 0<t<T (2.1) 
^0 Jo 

and the set of admissible trading and consumption pairs is 

A{xo) = {(vr,c) : X{tt,c) > 0, X_(7r, c) > and ct = Xr(7r, c)}. 

The convention ct = ^^(vr, c) means that all the remaining wealth is con- 
sumed at time T; it is merely for notational convenience. Indeed, X{tt,c) 
does not depend on ct, hence any given consumption strategy c can be rede- 
fined to satisfy ct = XtItt, c). We fix the initial capital xq and usually write 
A for A{xo). A consumption strategy c is called admissible if there exists tt 
such that (vr, c) € A; we write c £ A for brevity. The meaning of tt € ^ is 
analogous. 

Sometimes it is convenient to parametrize the consumption strategies as 
fractions of wealth. Let (vr, c) A and let X = X(tt, c) be the corresponding 
wealth process. Then 

k:=^ (2.2) 

is called the propensity to consume corresponding to (vr, c). Note that = 1 
due to our convention that ct = Xt- 

Remark 2.1. (i) The parametrization (vr, n) allows to express wealth pro- 
cesses as stochastic exponentials: by (12. ip . 



X(vr, k) = xo<f (vr • R — k • fi) (2.3) 
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coincides with X{Tr,c) for k := c/X{Tr,c), where we have used that the 
cadlag property imphes X{tt,c) = X{tt,c)- /i-a.e. The symbol • indicates 
an integral, e.g., n ' R = J tTscIRs- 

(ii) Relation (|2.2p induces a one-to-one correspondence between the pairs 
(tt, c) € A and the pairs (vr, n) such that ir A and k is a nonnegative 
optional process satisfying Kg ds < oo P-a.s. and ht = 1- Indeed, given 
(7r,c) G A, define k by (|2?2]) with X = X(7r,c). As > and as X 

is cadlag, almost every path of X is bounded away from zero and k has 
the desired integrability. Conversely, given (vr,K), define X via (|2.3p and 
c := kX; then X = X(7r,c). From admissibility we deduce vr^Ai? > —1 up 
to evanescence, which in turn shows X > 0. Now X_ > by a standard 
property of stochastic exponentials |8i II. 8a], so (vr, c) € A. 



Preferences. Let D be a cadlag adapted strictly positive process such that 
E[J^ Ds fi°{ds)] < oo and fix p G (-oo,0) U (0,1). We define the utility 
random field 

Ut{x) := Dt^xP, X G [0,oo), t e [0,r], 

where 1/0 := oo. We remark that Zariphopoulou [27] and Tehranchi |26) 
have previously used utility functions modified by certain multiplicative ran- 
dom variables, in the case where utility is obtained from terminal wealth. 
To wit, Ut{x) is any p -homogeneous utility random field such that a con- 
stant consumption yields finite expected utility, and therefore the most gen- 
eral utility random field that gives rise to the structure studied in this pa- 
per. In particular, our results do not apply to the additive specification 
U[{x) := ^{x + DtY that would correspond to a hedging or random endow- 
ment problem, except of course for trivial choices of D. 

In the sequel, we will sometimes assume that there are constants ki and 
k2 such that 

0<A;i<A<A;2, tG[0,r]. (2.4) 

The expected utility corresponding to a consumption strategy c G ^ is 
given by E\j'^ Ut{ct) ^° {dt)]. We recall that this is either E[Ut{ct)] or 

E[J^ Ut{ct) dt + Ut{ct)]- In the case without intermediate consumption, 
Ut is irrelevant for t <T. 

Remark 2.2. The process D can be used for discounting utility and con- 
sumption, or to determine the weight of intermediate consumption compared 
to terminal wealth. Our utility functional can also be related to the usual 
power utility function ^x^ in the following ways. If we write 



E 



i-T 



Jo 



Ut{ct)iJ°{dt) =E / l4dKt 



f-T 
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for dKt := Dt fj,°{dt), we have the usual power utihty, but with a stochastic 
clock K (cf. Goll and Kallsen |6]). In fact, one could also consider more 
general measures dK and obtain a structure similar to our results below. 

To model taxation of the consumption, let g > —1 be the tax rate and 
D := [1 + q)^p. If c represents the cashflow out of the portfolio, c/(l + g) 
is the effectively obtained amount of the consumption good, yielding the 
instantaneous utility i(ci/(l + gt)Y — Ut{ct). Similarly, Dt can model a 
multiplicative bonus payment. 

For yet another alternative, assume either that there is no intermediate 
consumption or that D is a martingale, and that E[Dt] = 1- Then 



E 



T 



Ut{ct)f,°{dt) =eP I ic?/i°(dt) 



T 



with the equivalent probability P defined by dP = Dt dP. This is the 
standard power utility problem for an agent with subjective beliefs, i.e., who 
uses P instead of the objective probability P. 

We assume that the value of the utility maximization problem is finite: 
u{xo) := sup E I Utict) fj,°idt) < oo. (2.5) 

This is a standing assumption for the entire paper. It is void if p < 
because then U < 0. If p > 0, it needs to be checked on a case-by- 
case basis (see also Remark 14. 7p . A strategy {n,c) € A{xo) is optimal if 
E^Jq Ut{ct) /i°(dt)] = u{xq). Of course, a no-arbitrage property is required 
to guarantee its existence. Let be the set of equivalent cj-martingale 
measures for S. If 

/ 0, (2.6) 

arbitrage is excluded in the sense of the NFLVR condition (see Delbaen and 
Schachermayer [3]). We can cite the following existence result of Karatzas 
and Zitkovic it was previously obtained by Kramkov and Schacher- 

mayer [15] for the case without intermediate consumption. 



Proposition 2.3. Under (|2.4p and ()2.6p . there exists an optimal strategy 
(vr, c) S A. The corresponding wealth process X = X{Tf,c) is unique. The 
consumption strategy c can be chosen to be cadlag and is unique P ® ^°-a.e. 

In the sequel, c denotes a cadlag version. We note that under (|2.6p . the 
requirement X(7r,c)_ > in the definition of A is automatically satisfied 
as soon as X(7r, c) > 0, because ^(vr, c) is then a positive supermartingale 
under an equivalent measure. 

Remark 2.4. In Proposition 12. 3[ the assumption on D can be weakened 
by exploiting that (|2.6p is invariant under equivalent changes of measure. 
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Suppose that D = D'D", where D' meets (|2.4p and D" is a martingale 
with unit expectation. As in Remark 12. 2| we consider the problem under 
the probability dP = D'^ dP, then Proposition 12.31 applies under P with D' 
instead of D, and we obtain the existence of a solution also under P. 



3 The Opportunity Process 

This section introduces the main object under discussion. We do not yet 
impose the existence of an optimal strategy, but recall the standing assump- 
tion (|2.5p . To apply dynamic programming, we introduce for each {tt,c) G A 
and t G [0, T] the set 



A{tt, c,t) = {{tt,c) £ a : (vf, c) = (vr, c) on [0, t] } . 



(3.1) 



These are the controls available on {t, T] after having used (vr, c) until t. The 
notation c G A{7r, c, t) means that there exists fr such that (tt, c) G A{tt, c, t). 
Given (vr, c) G A, we consider the value process 



Jt{Tr,c) := ess sup E 



Us{cs) n°{ds) 



(3.2) 



We choose the cadlag version of this process (see Proposition IA.2I in the 
Appendix) . The p-homogeneity of the utility functional leads to the following 
factorization of J. 

Proposition 3.1. There exists a unique cadlag semimartingale L, called 
opportunity process, such that 



Lt i(Xt(7r,c))^ = Ji(7r,c) = esssup E 

ceA{TT,C,t) 



Us{cs) fi°{ds) 



(3.3) 



for any admissible strategy (vr, c) G A. In particular, Lt = Dt- 



Proof. Although the statement seems to be well known for several special 
cases of our setting, we give a detailed proof in view of the importance for 
this paper. Let (vr,c), (vr,c) G A and X := X{tt,c), X := X{tt,c). We claim 
that 



-r- esssup E 

cGA{n,c,t) 



Us{cs) pL°{ds) 



1 



(3.4) 



—p esssup E 

ceA{-K,c,t) 



Usics) n°{ds) 
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Indeed, using the lattice property given in Fact lA.H we can find a sequence 
(c") in A{TT,c,t) such that, with a monotone increasing hmit. 



^r- ess sup E 



hm E 



T 



Usics) {ds] 



= ^hniE 
< ess sup E 

ceA{n,c,t) '-Jt 



T 



Us{cs) fJ-°ids] 



where we have used Fact IA.3l in the last step. The claim follows by symmetry. 



Thus, 



if we define Lt := Jt('7r, c)/ (^((vr, c))^] , L does not depend on the 
choice of (vr, c) ^ A and inherits the properties of J(7r, c) and ^(vr, c) > 0. □ 



The opportunity process describes [p times) the maximal amount of 
conditional expected utility that can be accumulated on [i, T\ from one 
unit of wealth. In particular, the value function (|2.5p can be expressed 
as u{x) = Lq^x'P. 

In a Markovian setting, the factorization of the value function (which 
then replaces the value process) is very classical; for instance, it can already 
be found in Merton |19] . In that setting there is also a number of cases 
where L is known explicitly for the case without intermediate consumption. 
See, e.g., Kraft [14] for Heston's model and Kallsen and Muhle-Karbe [9] 
for certain affine models including the CGMY model. For exponential Levy 
models an explicit solution is available also for the case with consumption 
(see Example 16. ip . 

Mania and Tevzadze |18) study power utility from terminal wealth in 
a continuous semimartingale model; that paper contains some of the basic 
notions used here as well. In fact, the opportunity process is present — in a 
more or less explicit form — in almost all works dealing with power utility. 
However, since it is impossible to discuss here this vast literature, we confine 
ourselves to indicating the most closely related references throughout this 
article. 



Remark 3.2. Let D be a martingale with Dq = 1 and P as in Remark 12.21 
Bayes' rule and (|3.3p show that L := L/D can be understood as "opportunity 
process under P" for the standard power utility function. 

Remark 3.3. We can now formalize the fact that the optimal strategies (in 
a suitable parametrization) do not depend on the current level of wealth, a 
special feature implied by the choice of power utility. If (vr, c) & A is optimal, 
X = X{tt, c), and k = c/X is the optimal propensity to consume, then (vr, k) 
defines a conditionally optimal strategy for the problem 



ess sup E 

ceA{n,c,t) 



Us{cs) fi° {ds] 



for any (vr,c) € ^1, t € [0,T]. 
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To see this, fix {it,c) € A and t € [0,T]. We define the pair (vr, c) by 

cl[o,t] + ^^c^t,T] and let X := X{7r,c). 



7rl[o,t] + 7rl(t,T] and c 



Note that (7r,c) is conditionally optimal in A{Tf,c,t), as otherwise Fact IA.l1 
yields a contradiction to the global optimality of (tt, c). Now (|3.4p with 
(vr, c) := (vTjc) shows that (7f,c) is conditionally optimal in A{7r,c,t). The 
result follows as c/X = c/X = k on (i, T] by Fact IA.3I 

The martingale optimality principle of dynamic programming takes the 
following form in our setting. 

Proposition 3.4. Let (vr, c) ^ A he an admissible strategy and assume that 
-^[/o ^ s{cs) ^J'° {ds)] > — oo. Then the process 

Lt^{Xt{7r,c)y + J\s{cs) Kds), t€[0,T] 

is a supermartingale; it is a martingale if and only if (vr, c) is optimal. 

Proof. Combine Proposition 13.11 and Proposition IA.2I □ 

The following lemma collects some elementary properties of L. The 
bounds are obtained by comparison with no-trade strategies, hence they are 
independent of the price process. If D is deterministic or if there are con- 
stants ki,k2 > as in (|2.4p . we obtain bounds which are model-independent; 
they depend only on the utility function and the time to maturity. 

Lemma 3.5. The opportunity process L is a special semimartingale. 
(i) If p G (0,1), L is a supermartingale satisfying 



Lt > {l^°[t,T]) "eI Dsfi°{ds 



0<t<T 



and L, L_ > 0. In particular, L > ki if D >ki. 
(a) If p <0, L satisfies 



(3.5) 



0<Lt< {fi°[t,T]) "E / Ds^l°{ds 



0<t<T 



(3.6) 



and in particular Lt < A;2 (^°[i, ^ ^ if D < k2. In the case without 

intermediate consumption, L is a suhmartingale. 

If there exists an optimal strategy (7r,c), then L,L^ > 0. 

Proof. Consider the cases where either p > 0, or p < and there is no 
intermediate consumption. Then vr = 0, c = xqI^x} is an admissible strat- 

r 1 P ■ 
Lf-Xn IS a 



egy and Proposition 13.41 shows that Lt-x^ + Us{0) fJ.{ds) 
supermartingale, proving the super/submartingale properties in (i) and (ii). 
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Let p be arbitrary and assume there is no intermediate consumption. 
Applying (|3.3p with vr = and c = xo1{t}) we get Lt^x^ > £'[C/r(cr)|-^t] = 
E[DT\Tt]^xl. Hence Lj > E[DT\J^t] if p > and Lt < E[DT\Tt] if p < 0, 
which corresponds to (|3.5p and (|3.6p for this case. 

If there is intermediate consumption (and p is arbitrary), we consume 
at a constant rate after the fixed time t. That is, we use (|3.3p with vr = 
and c = xo{T - t + l)~'^l[t,T] to obtain Lt^x^ > E[ Usics) fi°{ds)\Tt] = 

^x^Q{l+T-t)-PE[J^ DsH°{ds)\Tt]. This ends the proof of ([33]) and M . 

In the case p < 0, (|3.6p shows that L is dominated by a martingale, hence 
L is of class (D) and in particular a special semimartingale. 

It remains to prove the positivity. If p > 0, (|3.5p shows L > and 
then L_ > follows by the minimum principle for positive supermartin- 
gales. For p < 0, let X = X{Tt,c) be the optimal wealth process. Clearly 
-L > follows from (|3.3p with (7r,c). From Proposition 13.41 we have that 
^X^L + J Us{cs) ^{ds) is a negative martingale, hence X^L is a positive su- 

permartingale. Therefore P[info<t<T -'^^f -^^t > 0] = 1 and it remains to note 
that the paths of X^ are P-a.s. bounded because X,X^ > 0. □ 

The following concerns the submartingale property in Lemma 13.5( 11). 

Example 3.6. Consider the case with intermediate consumption and assume 
that D = 1 and S = 1. Then {tt,c) = (0,Xo/(l + T)) is an optimal strategy 
and Lt = (1 + T — t)^~P is a decreasing function. In particular, L is not a 
submartingale. 

Remark 3.7. We can also consider the utility maximization problem under 
constraints in the following sense. Suppose that for each {uj,t) G x [0,r] 
we are given a set '^t{^) Q I^"'- We assume that each of these sets contains 
the origin. A strategy (vr, c) G ^ is called 'if -admissible if TTt{uj) G ^i(i^) for 
all {uj,t), and the set of all these strategies is denoted by A"^ . We remark 
that all results (and their proofs) in this section remain valid if A is replaced 
by A'^ throughout. This generalization is not true for the subsequent section 
and existence of an optimal strategy is not guaranteed for general 'if. 

4 Relation to the Dual Problem 

We discuss how the problem dual to utility maximization relates to the op- 
portunity process L. We assume (|2.4p and ()2.6p in the entire Section |4l 
hence Proposition 12.31 applies. The dual problem will be defined on a do- 
main '3^ introduced below. Since its definition is slightly cumbersome, we 
point out that to follow the results in the body of this paper, only two facts 
about ^ are needed. First, the density process of each martingale measure 
Q G scaled by a certain constant yQ, is contained in "3^. Second, each 

element of is a positive supermartingale. 
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Following [TT], the dual problem is given by 

inf e\ f U:{Yt),,°{dt)\, (4.1) 

where i/q := u'{xq) = Lqx^~^ and is the convex conjugate of x i— )• Ut{x), 
U:{y) := sup {Ut{x) - xy} = -^'D^. (4.2) 

x>0 

We have denoted by 

/3:=-^>0, (7:= ^ G (-oo,0)U(0,l) (4.3) 
1 — p p — 1 

the relative risk tolerance and the exponent conjugate to p, respectively. 
These constants will be used very often in the sequel and it is useful to note 
sign(p) = — sign(g). It remains to define the domain = i^{yo)- Let 

^ = {H ' S : He L{S), H' S is bounded below} 

be the set of gains processes from trading. The set of "supermartingale 
densities" is defined by 

^* = {y > cadlag : Yq < yQ, YG is a supermartingale for all G £ 

its subset corresponding to probability measures equivalent to P on J^t is 

= {y g ^* : y > is a martingale and Yo = yo}. 

We place ourselves in the setting of [TT] by considering the same dual domain 
a^S^ C '3^*. It consists of the density processes of (the regular parts of) the 
finitely additive measures contained in the (t((L°°)*, L°°)-closure of the set 
{Yt : Y G ^-^l C C (L°°)*. More precisely, we multiply each density 
with the constant yQ. We refer to fll] for details as the precise construction of 
'3^^ is not important here, it is relevant for us only that '3^''^ C '3^^ C '3^*. In 
particular, yo^^ C "3^^ if we identify measures and their density processes. 
For notational reasons, we make the dual domain slightly smaller and let 

^ := {y G : y > 0}. 

By |11| Theorem 3.10] there exists a unique Y = Y{yQ) G such that the 
infimum in (|4.ip is attained, and it is related to the optimal consumption c 
via the marginal utility by 

Yt = d,Ut{x)\^=£,=Dt4-' (4.4) 

on the support of In the case without intermediate consumption, an 
existence result was previously obtained in |15] . 
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Remark 4.1. All the results stated below remain true if we replace '3/ by 
{y G '3/'* : Y > 0}; i.e., it is not important for our purposes whether we use 
the dual domain of jll) or the one of |15) . This is easily verified using the 
fact that '3^^ contains all maximal elements of (see |11[ Theorem 2.10]). 
Here Y € '3^* is called maximal if Y = Y'B, for some Y' ^* and some 
cadlag nonincreasing process B € [0, 1], implies B = 1. 

Proposition 4.2. Let (c, tt) ^ A be an optimal strategy and X = X{Tt,c). 
The solution to the dual problem is given by 

Y = LXP-\ 

Proof. As Lt = Dt and ct = Xt, (|4.4p already yields Yt = LtX^~^. 
Moreover, by Lemma IB. II in the Appendix, Y has the property that 

Zt := YtXt + f YsCs fi{ds) = YtXt +p f Us{cs) ^ds) 
Jo Jo 

is a martingale. By Proposition 13.41 Zt := LtXf +p Us{cs) ii{ds) is also a 
martingale. The terminal values of these martingales coincide, hence Z = Z. 
We deduce Y = LXP~^ as X > 0. □ 

The formula Y = LX^^^ could be used to define the opportunity process 
L. This is the approach taken in Muhle-Karbe |20) (see also |9]), where 
utility from terminal wealth is considered and the opportunity process is 
used as a tool to verify the optimality of an explicit candidate solution. 
From a systematic point of view, our approach via the value process has 
the advantage that it immediately yields the properties in Lemma 13.51 and 
certain monotonicity results (see Section |5]). 



4.1 The Dual Opportunity Process 



Since the function U* in the dual problem (|4.ip is again homogeneous, we 
expect a similar structure as in the primal problem. This is formalized by 
the dual opportunity process L*. Not only is it natural to introduce this 
object, it also turns out that in certain situations L* is a more convenient 
tool than L (e.g., |23]). We define for Y £ ^ and t e [0, T] the set 

^iY,t) :={Y : Y = Y on [0,t]} 

and we recall the constants (|4.3p and the standing assumptions (|2.4p and (|2.6p . 

Proposition 4.3. There exists a unique cadlag process L* , called dual op- 
portunity process, such that for all Y £ '3^ and t G [0, T], 



_ess inf E 
Ye^{Y,t) 



c/;(y,)^°(d.) 
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An alternative description is 



ess snvY&oy E Dl{Ys/YtY fi°{ds 



essinfye^ E Dl{Ys/YtY ii°{ds 



^/ge (0,1), 



and the extrema are attained atY = Y . 



Proof. The fork convexity of '3^ Theorem 2.10] shows that if y,y € 
and Y G then yi[o,i) + {Yt/Yt)Y\t,T] is in '3^{Y,t). It also imphes 

that 'li Ae Ft and Y^,Y'^ G then Y^Ia + YHac G '3/'{Y,t). The 

proof of the first claim is now analogous to that of Proposition 13.11 The 
second part follows by using that L* does not depend on Y . □ 

The process L* is related to L by a simple power transformation. 

Proposition 4.4. Let 13 = j^. Then L* = . 



Proof. The martingale property of Zt := XtYt+ CgYg jj,{ds) from Lemma [B. II 
implies that XtYt = E[ZT\Tt] - J^CsYsfiids) = E[ CsZ ^J.°{ds)\Ft] = 
E^J^ DgYs fJ-°{ds)\j-t\, where the last equality is obtained by expressing c 
via (|4.4p . The right hand side equals Y^L^ by Proposition 14. 3| so we have 
shown XY = Y1L*. On thejather hand, {LXP-^)i = Y^ by Proposition IM] 
and this can be written as XY = Y'^L^. We deduce L* = L'' as F > 0. □ 



4.2 Reverse Holder Inequality and Boundedness of L 

In this section we study uniform bounds for L in terms of inequalities of 
reverse Holder type. This will yield a corresponding result for the optimal 
consumption in Section |5]as well as a sufficient condition for (|2.5p . Moreover, 
uniform bounds for L are linked to the existence of bounded solutions for a 
certain class of backward stochastic differential equations, as explained in the 
companion paper [21j. Since bounded solutions are of particular interest in 
the theory of those equations, the detailed treatment below is also motivated 
by this link. 

Let q = be the exponent conjugate to p. Given a general positive 
process Y, we consider the following inequality: 

/ E[(Ys/Yry\Fr]fJ^°{ds)<Cg if(Z<0, 
/ E[(YjYry\Tr]fJ.°{ds)>Cg if(ZG(0,l), 

k J T 

for all stopping times < t < T and some constant Cq > independent 
of T. It is useful to recall that q < corresponds to p G (0, 1) and vice versa. 
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Without consumption, Rg(-P) reduces to E[iYT /YT-Y\F-r\ < Cq (resp. 



the converse inequahty). InequaUties of this type are well known. See, e.g., 
Doleans-Dade and Meyer ||5j for an introduction or Delbaen et al. |2] and the 
references therein for some connections to finance. In most applications, the 



considered exponent q is greater than one; Rg(-P) then takes the form as for 



g < 0. We recall once more the standing assumptions (|2.4p and (|2.6p . 

Proposition 4.5. The following are equivalent: 

(i) The process L is uniformly bounded away from zero and infinity. 



(a) Inequality Rg(-P) holds for the dual minimizer Y G "3^ . 



(Hi) Inequality Ry(P) holds for some 1" E 



Proof. Under the standing assumption (|2.4p . a one-sided bound for L always 
holds by Lemma l3.5[ namely L > fci if p € (0, 1) and L < const, if p < 0. 

(i) is equivalent to (ii): We use (|2.4p and then Propositions 14.3 1 and 14.4 
to obtain that E[{Ys/Yry\j^r] fJ-°ids) = E[jJ{Ys/YrytJ.°{ds)\Tr] < 
k^'^E[f^ D^{Ys/Yr)'i ^j.°{ds)\Tr] = k^'^L* = k^^L^. Thus when p G (0,1) 



and hence g < 0, Rg(-P) for Y is equivalent to an upper bound for L. For 



p < 0, we replace ki by k2- 

(iii) implies (i): Assume p € (0,1). Using Propositions and 143^ 
and 6J), -iy/Lf < E[Jfut{Ys)^^°{ds)\Ft] < -ffc^^ i?[y/| J-^] /.°(ds). 
Hence L < k2Cq^ . If p < 0, we obtain L > kiCq^ in the same way. □ 



If the equivalent conditions of Proposition 14.51 are satisfied, we say that 



Rq(P) holds" for the given financial market model. Although quite frequent 



in the literature, this condition is rather restrictive in the sense that it of- 
ten fails in explicit models that have stochastic dynamics. For instance, in 
the affine models of [9j, L is an exponentially affine function of a typically 



unbounded factor process, in which case Proposition 14.51 implies that Rg(P) 
fails. Similarly, L is an exponentially quadratic function of an Ornstein- 
Uhlenbeck process in the model of Kim and Omberg [13J. On the other 
hand, exponential Levy models have constant dynamics and here L turns 
out to be simply a smooth deterministic function (see Example 16. ip . 



In a given model, it may be hard to check whether Rg(-P) holds. Re- 
calling yo^^ C an obvious approach in view of Proposition I4.5f iii) is 
to choose for Y/yQ the density process of some specific martingale measure. 
We illustrate this with an essentially classical example. 

Example 4.6. Assume that i? is a special semimartingale with decomposi- 
tion 

R = a- {R'') + M^, (4.5) 
where denotes the continuous local martingale part of i?, a G Lf^^{R'^), 
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and is the local martingale part of R. Suppose that the process 

Xt-= [ aJd{R')sas, te[0,T] 
Jo 

is uniformly bounded. Then Z := £(—a • R'^) is a martingale by Novikov's 
condition and the measure Q k, P with density dQ/dP = Zt is a local 
martingale measure for S as Z£{R) = £{-a • R" + M^) by Yor's formula; 
hence yoZ G '3''. Fix q. Using = £{—qa • R'^) exp {^q{q — l)x) > that 
£{—qa • R'^) is a martingale by Novikov's condition, one readily checks that 



Z satisfies inequality ^q{P) 



If R is continuous, (|4.5p is the structure condition of Schweizer [24] and 
under (|2.6p R is necessarily of this form. Then x is called mean-variance 
tradeoff process and Q is the "minimal" martingale measure. In Ito process 
models, x takes the form xt = Jq ^J^s ds, where 9 is the market price of risk 
process. Thus x will be bounded whenever 9 is. 

Remark 4.7. The example also gives a sufficient condition for (|2.5p . This 
is of interest only for p G (0, 1) and we remark that for the case of Ito 
process models with bounded 9, the condition corresponds to Karatzas and 
Shreve |10| Remark 6.3.9]. 



Indeed, if there exists Y € '3^ satisfying Rq{P) , then with (|4.2p and (|2.4p 
it follows that the the value of the dual problem (|4.ip is finite, and this 
suffices for (|2.5p . as in Kramkov and Schachermayer [16j. 

The rest of the section studies the dependence of Jiq{P) on q. 

Remark 4.8. Assume that Y satisfies Rg(-P) with a constant Cq. If qi is 
such that q < qi < oi < q < qi < 1, then Rqj(P) is satisfied with 

Cq, = {fl°[0,T])'-''^\Cqr/l. 

Similarly, if (7 < < (;i < 1, we can take Cq, = {CqY^/'i. This follows from 
Jensen's inequality. 

There is also a partial converse. 

Lemma 4.9. Let < g < (/i < 1 and let Y > be a supermartingale. IfY 



satisfies Rq^(P), it also satisfies Kq{P) 



In particular, the following dichotomy holds: Y satisfies either all or none 

of 



of the inequalities {Kq{P) , q G (0,1)}. 

Proof. From Lemma [4 . 1 1 stated below we have E^{Ys/Yt)'^\j't\ fJ-°{ds) > 

{E[{Ys/Yt)'^^\l't])^ l^°ids). Noting that > 1, we apply Jensen's 

inequality to the right-hand side and then use Rgj(P) to deduce the claim 

with Cq := [fi°[t,T]) ^-"i {Cq,)^-n . The dichotomy follows by the previous 
remark. □ 
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For future reference, we state separately the main step of the above proof. 



Lemma 4.10. Let Y > be a supermartingale. For fixed < t < s < T , 
4> : (0, 1) ^ R+, 4>{q) ■= ( E [{¥.,/ Yty\Tt'_ 



1 

1-1 



is a monotone decreasing function P-a.s. If in addition Y is a martingale, 
then liniq^i^ (j){q) = exp [ — E[(Ys/Yt)log(Ys/Yt)\j't]) P-a.s., where the 
conditional expectation has values in RU {+00} . 

Proof. Suppose first that y is a martingale; by scaling we may assume 
E[Y,] = 1. We define a probability Q ^ P on J", by dQ/dP := F,. With 
r := (1 — g) G (0, 1) and Bayes' formula, 

0(g) = (Yl-'^E<^[Yr'\J't])^' =Yt(E'^[{l/Ysr\Tt 



This is increasing in r by Jensen's inequality, hence decreasing in q. 

Now let y be a supermartingale. We can decompose it as 1^ = B^Mu, 
u G [0,s], where Af is a martingale and Bg = 1. That is, Mt = E\Ys\J-t] 
and Bt = Yt/E[Ys\J-t\ > 1, by the supermartingale property. Hence B^^^'^ 
is decreasing in g G (0)1)- Together with the first part, it follows that 

0(g) = Bf^''~'^\E[{Ms/Mty\j^t])^ is decreasing. 

Assume again that y is a martingale. The limit limq^i_ log (0(g)) can 
be calculated as 

y log {E[iYjYt)''\Tt]) E[{Ys/Yt)''log{Ys/Yt)\Tt] 

Imi ^ — ■ — — = nm r , — ^ — ■ — - P-a.s. 

1-g 9^1- E[{Ys/Yt)i\Tt] 

using I'Hopital's rule and E[{Ys/Yt)\J-t] = 1. The result follows using mono- 
tone and bounded convergence in the numerator and dominated convergence 
in the denominator. □ 

Remark 4.11. The limiting case g = 1 corresponds to the entropic in- 
equality RLiogL(P) which reads /J S[(y,/yO log(y,/y,)| JV] ^^°{ds) < Ci. 
Lemma 14.101 shows that for a martingale y > 0, Rg^(P) with gi G (0,1) 
is weaker than RLiogL(-P)i which, in turn, is obviously weaker than Rqg(P) 
with go > 1. 

A much deeper argument [S] Proposition 5] shows that if y is a martingale 
satisfying the "condition (S)" that k'^Y^ <Y< kY^ for some k > 0, then 
y satisfies Rgy(P) for some go > 1 if and only if it satisfies Iiq{P) for some 
g < 0, and then by Remark 148) also Rqi(P) for all gi G (0, 1). 

Coming back to the utility maximization problem, we obtain the follow- 
ing dichotomy from Lemma 14.91 and the implication (iii) (ii) in Proposi- 
tion l431 
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Corollary 4.12. For the given market model, Jiq{P) holds either for all or 
no values of q £ (0, 1). 

We believe that this equivalence of reverse Holder inequalities is surpris- 
ing and also of independent probabilistic interest. 



5 Applications 

In this section we consider only the case with intermediate consumption. 
We assume (|2.4p and (|2.6p . However, we remark that all results except for 
Proposition 15.41 and Remark 15.51 hold true as soon as there exists an optimal 
strategy (tt, c) G A. 

We first show the announced feedback formula for the optimal propensity 
to consume k, which will then allow us to translate the results of the previous 
sections into economic statements. The following theorem can be seen as a 
generalization of \25l Proposition 8], which considers a Markovian model 
with Ito coefficients driven by a correlated factor. 

Theorem 5.1. With j3 = we have 

Ct = I — I Xt and hence Kt = I — I . (.5.1) 



■LtJ \Lt. 

Proof. This follows from Proposition 14.21 via (|4.4p and (|2.2p . □ 

Remark 5.2. In |2H Theorem 3.2, Remark 3.6] we generalize the formula 
for k to the utility maximization problem under constraints as described in 
Remark 13. 7| under the sole assumption that an optimal constrained strategy 
exists. The proof relies on different techniques and is beyond the scope of 
this paper; we merely mention that k is unique also in that setting. 

The special case where the constraints set C M"^ is linear can be de- 
duced from Theorem I5.1l bv redefining the price process S. For instance, set 
51 = 1 for ^ = {{x^,...,x'^) : = 0}. 

In the remainder of the section we discuss how certain changes in the 
model and the discounting process D affect the optimal propensity to con- 
sume. This is based on (15.11) and the relation 



j-T 

^XqLi = ess sup E ' 



l\,lcf,f,°{ds)\Tt\, (5.2 



which is immediate from Proposition 13.11 In the present non-Markovian 
setting the parametrization by the propensity to consume is crucial as one 
cannot make statements for "fixed wealth". There is no immediate way to 
infer results about c, except of course for the initial value cq = koXQ. 
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5.1 Variation of the Investment Opportunities 

It is classical in economics to compare two "identical" agents with utility 
function [/, where only one has access to a stock market. The opportunity 
to invest in risky assets gives rise to two contradictory effects. The presence 
of risk incites the agent to save cash for the uncertain future; this is the 
precautionary savings effect and its strength is related to the absolute pru- 
dence ^(U) = —U"'/U". On the other hand, the agent may prefer to invest 
rather than to consume immediately. This substitution effect is related to 
the absolute risk aversion £/{U) = —U"/U'. 

Classical economic theory (e.g., Collier [7, Proposition 74]) states that 
in a one period model, the presence of a complete financial market makes 
the optimal consumption at time t = smaller if ^{U) > 2£^{U) holds 
everywhere on (0, oo), and larger if the converse inequality holds. For power 
utility, the former condition holds if p < and the latter holds if p G (0, 1). 
We go a step further in the comparison by considering two different sets of 
constraints, instead of giving no access to the stock market at all (which is 
the constraint {0}). 

Let and be set-valued mappings of constraints as in Remark 13. 7[ 
and let C ^ in the sense that '^/(w) ^ ^((w) for all (t,a;). Assume that 
there exist corresponding optimal constrained strategies. 

Proposition 5.3. Let k and k! be the optimal propensities to consume for 
the constraints ^ and , respectively. Then C ^ implies k < k' if p > 
and k > k' if p < 0. In particular, cq < Cq if p > and cq > Cq if p < 0. 

Proof Let L and L' be the corresponding opportunity processes; we make 
use of Remarks 13.71 and 15.21 Consider relation (|5.2p with A'^ instead of A 
and the analogue for L' with A'^ . We see that A'^ C A'^ implies -L' < -L, 
as the supremum is taken over a larger set in the case of By (jS^ip . k is a 
decreasing function of L. □ 

Proposition 5.4. The optimal propensity to consume satisfies 

fe<:^^ ./J.€(0,1) »..>|^ ifp<0. 

In particular, we have a model-independent deterministic threshold indepen- 
dent of p in the standard case D = 1, 

- -t ^ - 1 + T -t ^ ^' 

Proof. This follows from Lemma 13.51 and (|5.ip . The second part can also be 
seen as special case of Proposition 15.31 with constraint set = {0} since 
then k' = (1 + T — t)~^ as in Example 13.61 □ 
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The threshold (1 + T — t)~^ coincides with the optimal propensity to 
consume for the log- utility function (cf. |6]), which formally corresponds to 
p = 0. This suggests that the threshold is attained by k{p) in the limit 
p — 7> 0, a result proved in |23) . 

Remark 5.5. Uniform bounds for k opposite to the ones in Proposition 



exist if and only if Rg(P) holds for the given financial market model. Quan- 



titatively, if Cg > is the constant for Kq{P) then 



kt > 



ko\P 1 



if p G (0, 1) and kt < 



1 



if p < 0. 



This follows from (|5.ip and (|2.4p by (the proof of) Proposition 14.51 In view 
of Corollary 14.121 we have the following dichotomy: k = k{p) has a uniform 
upper bound either for all values of p < 0, or for none of them. 



5.2 Variation of D 

We now study how k is affected if we increase D on some time interval 
[ti, ^2)- To this end, let < ti < t2 < T be two fixed points in time and ^ a 
bounded cadlag adapted process which is strictly positive and nonincreasing 
on [ti, t2). In addition to Ut{x) = Dt^x^ we consider the utility random field 

Ul{x):=D[lxf', Z)':=(l + ei[,,,,,))Z). 

As an interpretation, recall the modeling of taxation by D from Re- 
mark 12.21 Then we want to find out how the agent reacts to a temporary 
change of the tax policy on [ti, t2) — in particular whether a reduction of the 
tax rate g := D^^^p — 1 stimulates consumption. For p > 0, the next result 
shows this to be true during [ii, ^2); while the contrary holds before the pol- 
icy change and there is no effect after t2- An agent with p < reacts in the 
opposite way. Remark 12.21 also suggests other interpretations of the same 
result. 

Proposition 5.6. Let k and k' be the optimal propensities to consume for 
U and U' , respectively. Then 

k'-t < kt if t < ti, 
< k't> kt if t £ [ti,t2), 
^k't = kt if t> t2. 

Proof. Let L and L' be the opportunity processes for U and U'. We con- 
sider (|5.2p and compare it with its analogue for L', where D is replaced by D' . 
As ^ > 0, we then see that L't > Lt for t < ti; moreover, = Lt for t > t2- 
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Since ^ is nonincreasing, we also see that L[ < {l + ^t)Lt for t G [^1,^2)- It re- 
mains to apply dSH). For t < h, k' = {D'jL^f = {Dt/L[f < {Dt/Ltf = k. 
For t € [^1,^2) we have 

while for t >t2, D[ = Dt implies k[ = kt- □ 

Remark 5.7. (i) For t2 = T, the statement of Proposition I5.6l remains true 
if the closed interval is chosen in the definition of D. 

(ii) One can see |25l Proposition 12] as a special case of Proposition 15.61 
In our notation, the authors consider D = 1[o,t)-^i + l{r}-^2 for two con- 
stants Ki, K2 > and obtain monotonicity of the consumption with respect 
to the ratio K2/K1. This is proved in a Markovian setting by a comparison 
result for PDEs. 



6 On the Optimal Trading Strategy 

In this section we indicate how the opportunity process L describes the opti- 
mal trading strategy tt. This issue is thoroughly treated in |2li| and our aim 
here is only to complete the picture of how the opportunity process describes 
the power utility maximization problem. The following holds whenever an 
optimal strategy (vr, k) exists and in particular when the conditions of Propo- 
sition [2]3] are satisfied. 

Our description for vr is local, i.e., we fix {u^t) € x [0,T] and char- 
acterize the vector TTt{oj) € W^. We shall see that this vector maximizes a 
certain concave function or more precisely, a function y 1— )• g{u;,t,y) on a 
subset 't^ti'^) of K''- Therefore, ttj (w) can be seen as the optimal control for 
a deterministic control problem whose admissible controls are given by the 
set %°{uj): 

TTtiijj) = aTgmaxg{uj,t,y), (c<J,t) € x [0, T]. (6.1) 

The set 'rf^{io) is a local description for the budget constraint, i.e., the con- 
dition that the wealth process X{tt,k) corresponding to some strategy (vr, k) 
has to be positive. 

To formally define '^^{oj)^ we first have to introduce the semimartingale 
characteristics of R (cf. |8l Chapter II] for background). Let h : ^ 
be a cut-off function, i.e., h is bounded and h{x) = x in a neighborhood 
of X = 0. Moreover, we fix a suitable increasing process A and denote by 
{b^, c^, A) the differential characteristics of R with respect to A and h. 
In the special case where i? is a Levy process, one can choose At = t and then 
{b^,c^, F^) is the familiar Levy triplet. In general, the triplet {b^,c^, F^) 
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is stochastic, but for fixed the interpretation is similar as in the Levy 

case. In particular, F/^(a;) is a Levy measure on M.'^ and describes the jumps 
of R. With this notation we can define 

^O(w) := |y e R'^ : Ff {Lo){x G R'^ : y^x < -l} = o}. 

This formula is related to the budget constraint because the stochastic expo- 
nential X{7r, k) = Xo£(^7r ' R — k • is nonnegative if and only if the jumps 
of its argument satisfy 7r'''Ai2 > — 1, and this condition is expressed by the 
above formula in a local way. We refer to \21\ § 2.4] for a detailed discussion 
and references to related literature. 

It remains to specify the objective function g of the local optimiza- 
tion problem (|6.ip . To this end, we consider the M'^ x M- valued semi- 
martingale {R,L). We denote a generic point in x M by {x,x') and 
by [b^'^ ,c^''^ , F^'^; A) the joint differential characteristics of {R,L) with 
respect to A and the cut-off function {x,x') i— >■ {h{x),x'); here the last co- 
ordinate does not require a truncation because L is special (Lemma 13. 5p . 
Suppressing (w, t) in the notation, we can now define 

g{y) := L^y^ (b^ + + + / xV Hx) F'^^^dix^x')) 

+ I {L^^x'){v-^(\^y^xY -v'^ -y^h(x)]F^-^^{d{x,x')). 

One can check (cf. |21| Appendix A]) that y i— g{u},t,y) is a well defined 
concave function on 'la^iuj) taking values in the extended real line. With the 
above notation, and under the assumption that an optimal strategy (tt, k) 
exists, |2H Theorem 3.2] states that the local description (|6.ip for vr holds 
true P ® ^-a.e. 

We conclude by an illustration of this result in the Levy case (see |22] 
for details). 

Example 6.1. Let i? be a scalar Levy process with Levy triplet (6^, c^, F^) 
such that R is neither an increasing nor a decreasing process (then the no- 
arbitrage condition (|2.6p is satisfied). We assume that the price process 
S = £{R) is strictly positive, or equivalently that F^(—oo,—l] = 0. We 
consider the standard power utility function U{x) = and focus on the 
case with intermediate consumption for simplicity of notation. For p £ (0, 1), 
it turns out (see |22| Corollary 3.7]) that our standing assumption (|2.5p is 
satisfied if and only if J |2^|^l{|x|>i} F^{dx) < oo, and for p < we have seen 
that the assumption is always satisfied. 

The Levy setting has the particular feature that the opportunity process 
and the function g are deterministic. More precisely, g{uj,t,y) = LtQ{y) for 
the deterministic and time-independent function 

fl(y):=y^6« + ^y"^A+ / {p-\l + y'^ xf - p-' - y'^ h{x)} F^" {dx) . 
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Since L is positive, maximizing g is equivalent to maximizing g and so (|6.ip 
can be stated as 

vr = argmax0(y), 

where we note that 'is^ is simply a subset of M because is deterministic 
and time-independent. In particular, the optimal trading strategy tt is given 
by a constant. Moreover, setting a := maXy^^go 0(y), the explicit formula 
for the opportunity process is 

Li = aP-i[(l + a)e"(^-*)-l]'~^ 

and then by (|5.ip the optimal propensity to consume is 

Kt = I/l'/^'-^^ =a[{l + a)e'^(^-*) - 

We refer to [221 Theorem 3.2] for the proof and references to related litera- 
ture. 

A Dynamic Programming 

This appendix collects the facts about dynamic programming which are 
used in this paper. Recall the standing assumption (|2.5p . the set A{7T,c,t) 
from (|3.ip and the process J from (|3.2p . We begin with the lattice property. 

Fact A.l. Fix {tt,c) G A and let Ttic) := E[jf U s{cs) IJ° {ds)\Ft]. The set 
{Tt{c) '■ c G ^(7r,c, t)} is upward filtering for each t G [0, T]. 

Indeed, if (7r*,c*) G A{-K,c,t), i = 1,2, we have Tt{c^) V Tt{c^) = Tt{c^) 
for (7r3,c3) := {tt^,^)Ia + (vr^c^)^^ with A := {Tt{^) > Ftic'^)}. Clearly 
{tt'^,c^) G A{'7T,c,t). Regarding Remark 13. 7| we note that vr^ satisfies the 
constraints if vr^ and vr^ do. 

Proposition A. 2. Let (vr,c) G A and It{TT,c) := Jt{TT,c) + Jq [/^(cs) /x(ds). 
If E[\It{Tr,c)\] < oo for each t, then /(tt, c) is a supermartingale having a 
cadlag version. It is a martingale if and only if (tt, c) is optimal. 

Proof. The technique of proof is well known; see El Karoui and Quenez |12] 
or Laurent and Pham ^JTj for arguments in different contexts. 

We fix (vr, c) G ^ as well asO<t<'U<T and prove the supermartin- 
gale property. Note that It{'Tr,c) = ess supgg^(^ j,^^) Tf(c) for the martingale 

Tt(c) := E^jQUs{cs)lJ,°{ds)\j-t\- (More precisely, the expectation is well 
defined with values in M U {— oo} by (|2.5p .) 

As T„(c) = r„(c) -|- Jq Us{cs) n{ds), Fact lA.l] implies that there exists 
a sequence (c") in A{7r,c,u) such that lim„Tu(c") = /u(7r,c) P-a.s., where 
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the limit is monotone increasing in n. We conclude that 
£;[4(7r,c)|7-t] = i^[limT„(c")l7-t] = Wia E[T ^{d')\Ft\ 

n n 

< ess sup5g^(^_c^„) E[Tuic)\Tt] = ess sup5g^(^_c^„) Tf(c) 

< ess sup£g_4(^_c i) Tt{c) = It{TT,c). 

To construct the cadlag version, denote by I' the process obtained by 
taking the right limits of i i— > It{iT,c) =: It through the rational numbers, 
with := It- Since I is a supermartingale and the filtration satisfies the 
"usual assumptions", these limits exist P-a.s., I' is a (cadlag) supermartin- 
gale, and < It P-a.s. (see Dellacherie and Meyer ^ IV. 1.2]). But in fact, 
equality holds here because for all (vr, c) G A{tt, c, t) we have 



Ttic) = E 



[ Usics) dfi° J't] = E[It{^, c)\Ft] = E[lT\Tt] < I't 



due to It = I't-, and hence also I't > ess supgg^(^ j,^^) T((c) = It. Therefore /' 
is a cadlag version of I. 

We turn to the martingale property. Let (vr, c) be optimal, then /o(7r, c) = 
To(7r,c) = E[lT{Tr,c)], so the supermartingale /(vr,c) is a martingale. Con- 
versely, this relation states that (tt, c) is optimal, by definition of /(vr, c). □ 

The following property was used in the body of the text. 

Fact A. 3. Consider (vr, c), (vr', c') G A with corresponding wealths Xt,Xj- at 
time t e [0,r] and (vr",c") G ^(vr',c',t). Then 

cl[o,i] + ^ c" G^(vr,c,t). 

Indeed, for the trading strategy 7rl[o,j] + vr"l(^ 2-], the corresponding wealth 
process is Xl^Q^t] + Tl^"ht,T] > by M . 



B Martingale Property of the Optimal Processes 

The purpose of this appendix is to provide a statement which follows from 
and is known to its authors, but which we could not find in the literature. 
For the case without intermediate consumption, the following assertion is 
contained in |15| Theorem 2.2]. 

Lemma B.l. Assume (|2.4p and (|2.6p . Let (vr, c) £ A, X = X(vr,c) and 
y G then 

Zt := XtYt + [ CsYs fx{ds), t G [0, T] 
Jo 

is a supermartingale. If {X,c,Y) = (X,c,Y) are the optimal processes solv- 
ing the primal and the dual problem, respectively, then Z is a martingale. 
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Proof. It follows from [TH Theorem 3.10(vi)] that E[Zt] = E[Zq\ for the 
optimal processes, so it suffices to prove the first part. 

(i) Assume first that Y € ^^-^^ i.e., Y/Yq is the density process of a 
measure Qp^ P. As '3/''^ C the process X + / c„ [x{du) = xq + J X-vr dR 
is a Q-supermartingale, that is, E^\Xi + c„ < + Jq Cufji{du) 
for s <t. We obtain the claim by Bayes' rule. 



< X.^Y,. 



(ii) Let Y G be arbitrary, then by jll^ Corollary 2.11] there is 
a sequence Y" G '3^''^ which Fatou-converges to Y. Consider the super- 
martingale Y' := liminf„y". By Zitkovic |28| Lemma 8], Y^ = Yt P-a.s. 
for all i in a (dense) subset A C [0, T] which contains T and whose comple- 
ment is countable. It follows from Fatou's lemma and step (i) that Z is a 
supermartingale on A; indeed, for s < t in A, 



E 



XtYt+ / CuYu^i{du) 



E 



XtYl+ / c„yj/i(dn] 



< lim inf E 



xtYr+ / cuY:,,{du) 



< liminfX.y," 



XsYs P-a.s. 



We can extend Z\\ to [0,T] by taking right limits in A and obtain a right- 
continuous supermartingale Z' on [0,T], by right-continuity of the filtration. 
But Z' is indistinguishable from Z because Z is also right-continuous. Hence 
Z is a supermartingale as claimed. □ 
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